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Background and purpose Non-anatomic bone tunnel placement 
is the most common cause of a failed ACL reconstruction. Accu- 
rate and reproducible methods to visualize and document bone 
tunnel placement are therefore important. We evaluated the reli- 
ability of standard radiographs, CT scans, and a 3-dimensional 
(3D) virtual reality (VR) approach in visualizing and measuring 
ACL reconstruction bone tunnel placement. 

Methods 50 consecutive patients who underwent single-bundle 
ACL reconstructions were evaluated postoperatively by standard 
radiographs, CT scans, and 3D VR images. Tibial and femoral 
tunnel positions were measured by 2 observers using the tradi- 
tional methods of Amis, Aglietti, Hoser, Staubli, and the method 
of Benereau for the VR approach. 

Results The tunnel was visualized in 50-82% of the standard 
radiographs and in 100% of the CT scans and 3D VR images. 
Using the intraclass correlation coefficient (ICC), the inter- and 
intraobserver agreement was between 0.39 and 0.83 for the stan- 
dard femoral and tibial radiographs. CT scans showed an ICC 
range of 0.49-0.76 for the inter- and intraobserver agreement. 
The agreement in 3D VR was almost perfect, with an ICC of 0.83 
for the femur and 0.95 for the tibia. 

Interpretation CT scans and 3D VR images are more reliable 
in assessing postoperative bone tunnel placement following ACL 
reconstruction than standard radiographs. 



Non-anatomic bone tunnel placement has been reported to be 
the most common cause of a failed ACL reconstruction (Khal- 
fayan et al. 1996, Zantop et al. 2007). Although the anatomic 
attachment sites of the ACL have been well described, the 
optimal bone tunnel placement for ACL grafts remains con- 
troversial. Given the importance of bone tunnel placement for 
the success of the procedure, radiographic methods to post- 



operatively assess bone tunnel placement would be helpful in 
documenting postoperative outcomes. 

Recent studies have validated the use of 3D CT scans and 
MRI for evaluation of ACL bone tunnel placement postopera- 
tively (Abebe et al. 2009, Forsythe et al. 2010). The authors 
have questioned the reliability of conventional radiographs to 
evaluate ACL bone tunnel placement (Forsythe et al. 2010). 

MRI is a good imaging modality for direct visualization 
of the ACL graft (McCauley et al. 2003, Moon et al. 2008). 
However, there have been no studies on the reliability of MRI 
scans to document bone tunnel placement following ACL 
reconstruction. Recently, a new 3D viewing and measurement 
method was developed for visualization of the ACL recon- 
struction. This method uses CT data and an immersive virtual 
reality system. We evaluated the reliability of standard radio- 
graphs, CT scans, and a 3D VR approach for evaluation of 
ACL bone tunnel placement. 



Patients and methods 

We prospectively evaluated 50 consecutive patients (mean age 
27 (18^1) (6.9 SD) years, 38 men) who underwent a primary 
ACL reconstruction from January 2007 until May 2008 (trial 
number ISRCTN 40231111). Patients gave their written con- 
sent and permission to participate in the study and institutional 
approval for the study was granted by the Medical Review 
Board of our institute. 

ACL reconstruction was performed using an arthroscopic, 
single-incision, single-bundle, transtibial surgical technique 
using either bone-patella tendon-bone (BPTB) or a looped 
semi-tendinosus, gracilis autograft. The femoral and tibial 
bone tunnels were positioned within the native anatomic ACL 
footprint. ACL reconstructions performed using a BPTB graft 
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Figure 1. Measurement of the femoral tunnel on the coronal CT recon- 
struction, performed according to Hoser et al. (2005). The tunnel is 
measured in comparison to the line perpendicular to the most distal 
points of the femoral condyles. The measurement is compared to the 
line from the intracondylar roof to the distal femoral condyles. 



Figure 2. Medial-lateral measurement in the coronal CT reconstruction 
of the tibial tunnel. The tunnel measurement is compared to the line 
through the most medial and lateral part of the tibial plateau. 




Figure 3. A. Lateral view of the lateral femoral condyle by the method of Amis (Amis et al. 1994). The yellow dots are the 
user-defined edges of the posterior femoral condyle. A circle is automatically fitted on to the dots and can be rotated, in such 
a way that the diameter is parallel to Blumensaat's line. B. Lateral view of the lateral femoral condyle by the method of Aglietti 
(Aglietti et al., 1995). These authors compare the tunnel measurement to a line parallel to the most posterior and anterior part 
of Blumensaat's line. C. Measurement according to Aglietti on the sagittal femoral CT reconstruction. 



were fixed on both sides using a resorbable interference screw 
(BIORCI; Smith and Nephew, Andover, MA). Hamstring 
ACL reconstructions were fixed using an extracortical button 
technique (Endobutton; Smith and Nephew) on the femoral 
side and a resorbable interference screw on the tibial side 
(BIORCI). 

Imaging 

Standard radiographs were taken 6 weeks postoperatively 
when the patient was able to bear weight fully and to fully 
extend the knee. The AP radiograph was taken with the patient 
bearing full weight on the operative knee. The lateral radio- 
graph was taken with the knee in extension, with an optimal 
overlay of the femoral condyles. 

A 64-channel multi-slice technology CT scanner (Somatom; 
Siemens Medical Solutions, Forchheim, Germany) with heli- 
cal acquisition in 1.0-mm sections (120 kV, 160 mAs, rotation 
time 1.0 s) was used to perform CT scans. The knee CT imag- 
ing was performed from the top of the suprapatellar collection 



to the superior tibial and fibula diaphysis, one day postopera- 
tively. 

Measurements 

Measurements were performed digitally on all radiographs 
and CT slices. For all radiographic measurements, a tunnel 
was only rated as being visible if the tunnel and the necessary 
points to carry out the measurement were visible. In the AP 
image, we measured the femoral tunnel according to Hoser 
(Hoser et al. 2005) and the position of the tibial tunnel was 
measured as a percentage of the total tibial width from medial 
to lateral. These 2 measurements were also performed on cor- 
onal CT reconstructions (Figures 1 and 2). 

On the lateral radiograph, the methods of Aglietti et al. 
(1995) and Amis et al. (1994) were used to measure the posi- 
tion of the femoral tunnel (Figure 3). On the sagittal CT 
images, the femoral tunnel was measured by the method of 
Aglietti since the Amis method is not feasible because Blu- 
mensaat's line and the femoral condyles are not in the same 
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Figure 4. Measurement according to Staubli (Staubli and Rauschning, 
1994) on the sagittal tibial CT reconstruction. The aperture of the tibial 
tunnel is compared to the line parallel to the joint line, through the most 
anterior and posterior points of the intracondylar tibial plateau. 




Figure 5. View of the lateral femoral condyle. The red triangle is used in 
the 3D visualization technique calculations, a = line equal to Blumen- 
saat's line. BA = the most anterior point of Blumensaat's line. BP = the 
most posterior point. T = tunnel entrance, e = the line perpendicular 
to a, from the tunnel entrance. Lines b and c are the lines connecting 
T with Ba and Bp, respectively. This makes it possible to calculate the 
length of d, thus giving a percentage of the AP positioning of the tunnel 
position on the Blumensaat line comparable to Aglietti's method. 



sagittal CT slice. The tibial tunnel position was measured 
as a percentage of the anterior to posterior tibia diameter in 
both the standard radiograph and in CT images according to 
method of Staubli et al. (1994) (Figure 4). 

Measurements were performed blind on images in such a 
way that each method was performed in random order for all 
patients before starting with another method. This protocol 
avoided the possibility that the observer could use the infor- 
mation from one measurement method in another method. 2 
observers carried out all measurements independently. The 
experience of the observers in interpreting ACL reconstruc- 
tion positioning images ranged from none with the 3D VR 
system to more than 12 years with the standard radiographs. 
After 6 weeks, all measurements were performed a second 
time by one observer to calculate intraobserver reproducibil- 
ity. In the second sequence of CT measurements, the observer 
had to decide (again) the slide on which to perform the mea- 
surement. 

3D virtual reality measurements 

Measurements were performed using an I-Space immersive 
virtual reality system (I-Space; Barco NV, Kortrijk, Belgium) 
in 3D, which works similarly to the triangle method by Bena- 
reau (Figure 5) (Chouteau et al. 2007). The 3D VR approach 
uses a 4- sided immersive virtual environment where — with 
the aid of 8 projectors and polarizing glasses — the bony struc- 
tures are projected as free-floating 3D objects in the room. The 
system uses the V-Scope direct volume-rendering software 
developed at our institute, and high resolution CT scans to 
visualize the bones (Koning 2009). Using a wireless joystick, 
it is possible to rotate the bones in three dimensions and point 
out distinctive points on the bony structure with a precision of 
0.1 mm (Verwoerd-Dikkeboom et al. 2008). 

Statistics 

Intraclass correlation coefficient (ICC) was calculated using 



the percentages of the different measurements. The calcula- 
tion of the ICC is based on an analysis of variance (ANOVA) 
model. The first source of variance is the difference between 
the patients we measured. The second source of variability is 
the variance among the observers. The ICC calculations that 
were performed used the 2-way mixed model for absolute 
agreement. The ICC can be expressed on a scale from 0 to 1, 
where 0 expresses disagreement and 1 is perfect agreement. A 
score of 0.7 and higher is generally considered to be good in 
reliability studies (Nunnally 1994). We used chi-square test to 
determine the difference in radiographic visibility of the tun- 
nels between the graft types. 



Results 

Tunnel visibility 

CT allowed visualization of the femoral and tibial tunnels in 
both the AP and the lateral planes in all cases; visualization 
was less for the standard radiographs. It was more difficult 
to visualize the femoral tunnel (26/50) than the tibial tunnel 
(41/50) (p = 0.01). Femoral tunnel visibility on the lateral 
knee radiograph was lower in the ACL reconstruction with 
hamstring (4/16) than with BPTB (22/34) (p = 0.01). 

Interobserver reliability (Table) 

In the AP radiographs, the ICC of the femoral method was 0.39 
and that of the tibial was 0.43. On the lateral radiograph, the 
method of Amis gained the highest ICCs. The Amis method 
gave 0.62 as opposed to 0.53 for the method of Aglietti. The 
ICC for the tibial position on the lateral radiograph was 0.53. 

CT gave higher ICCs than the radiographs. The femur in the 
coronal plane gave the lowest ICC (0.49). The ICC of the tibia 
in the coronal plane (0.76) was considered good. The ICCs of 
the femur (0.71) and tibia (0.61) in the sagittal plane were in 
substantial agreement. 
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Intraclass correlation coefficients (ICCs) 



Interobserver Intraobserver 
ICC (95% CI) ICC (95% CI) 



AP radiograph 



Femur (Hoser) 


0.39 


(-0.32 to 0.81) 


0.47 


(-0.1 2 to 0.83) 


Tibia (med-lat) 


0.43 


(0.12-0.66) 


0.43 


(0.05-0.71) 


Lateral radiograph 










Femur (Aglietti) 


0.53 


(0.03-0.82) 


0.83 


(0.50-0.95) 


Femur (Amis) 


0.62 


(0.20-0.84) 


0.72 


(0.23-0.92) 


Tibia (Staubli) 


0.53 


(0.21-0.75) 


0.82 


(0.60-0.92) 


CT coronal 










Femur (Hoser) 


0.49 


(0.25-0.68) 


0.60 


(0.39-0.75) 


Tibia (med-lat) 


0.76 


(0.27-0.90) 


0.90 


(0.83-0.94) 


CT sagittal 










Femur (Aglietti) 


0.71 


(0.47-0.84) 


0.87 


(0.79-0.93) 


Tibia (Staubli) 


0.61 


(-0.05 to 0.84) 


0.63 


(0.18-0.82) 


3D Virtual Reality 










Femur (Benareau) 


0.83 


(0.70-0.90) 


0.85 


(0.75-0.92) 


Tibia (Staubli) 


0.95 


(0.92-0.97) 


0.96 


(0.93-0.98) 



The 3D VR approach resulted in the highest interobserver 
ICCs of all methods: 0.83 for the femur and 0.95 for the tibia. 



Discussion 

The 3D VR approach resulted in the highest ICCs and showed 
that measurement of the complex anatomy of the knee can 
be carried out reliably. The existing methods, using standard 
radiographs, showed a significantly lower visibility, especially 
regarding the use of the hamstring graft. At its best, the inter- 
and intraobserver agreement was substantial. CT showed opti- 
mal visibility, but only showed slightly better agreement — 
especially for the femur — because of its complex 3D shape. 

Only 1 previous study has determined the reliability of mea- 
surements on the lateral femur (Klos et al. 2000). The authors 
reported an ICC of 0.68 with the method of Amis, but with flu- 
oroscopically controlled placement before drilling of a femo- 
ral tunnel. The ICC found is in concordance with our findings, 
where the method of Amis produced the best ICC for radio- 
graphs (0.62). Furthermore, only one study has investigated 
the best modality (Hoser et al. 2005) and the authors con- 
cluded that there was no significant difference in the values of 
the tunnel position in the lateral femur measured on the radio- 
graph and by CT. Based on our study, however, CT is more 
reliable than radiography in the lateral femur measurements. 

Another method is the use of the clock, a popular reference 
method for intraoperative positioning of the femoral tunnel. It 
has been used in numerous studies, both clinical (Behrend et 
al. 2006) and anatomical (Amis et al. 1994, Giron et al. 2006). 
The method has certain disadvantages: there is no standardized 
clock shape or position, and it is very difficult to standardize 
the measurement since there are a number of variables that 
influence the measurement (Yoo et al. 2008). The variables to 
consider are (1) the position of the knee and its flexion angle 



and coronal positioning, (2) the viewpoint of the observer, and 
(3) the shape of the intercondylar space. 

Conventional radiographs showed low ICC and also poor 
visibility, especially in the AP projection. We encountered a 
relatively low visibility rate compared to other studies, because 
we used a biologically resorbable fixation screw, which is not 
radio-opaque. Previous studies may have measured the metal 
interference screw position or the femoral aiming device 
position, which, however, need not correlate with the actual 
tunnel or graft position (Klos et al. 2000). In addition, the time 
between the surgery and radiography was short, so there were 
no sclerotic lines present, which could have helped to identify 
the position of the tunnel. 

The CT scans gave more reliable measurements than the 
radiographs. However, one must bear in mind that CT scans 
are more expensive and that the patient is exposed to a higher 
dose of radiation. There has been growing interest in visual- 
ization of the ACL insertions and their relationship to bony 
landmarks using high-resolution volume rendering CT (Bas- 
dekis et al. 2009, Purnell et al. 2008). This technique uses the 
same CT images as in our study, but visualization and mea- 
surement is done on a computer screen. This measurement, 
however, limits the measurements to the 2 dimensions of the 
screen being viewed and probably makes it more susceptible 
to positioning inaccuracies, as shown in the moderate ICCs 
obtained for our CT measurements. 

Based on the present study, the 3D VR approach is the most 
reliable system for performing measurements on the recon- 
structed ACL. The possibility to visualize the bone from any 
desired position allows many possibilities for measurement of 
other distances also, and for evaluation of anatomy. However, 
the use of virtual reality solutions to evaluate patients in clini- 
cal practice remains somewhat futuristic, and this method has 
not yet been introduced in clinical practice. The disadvantages 
of an immersive virtual reality system are, for example, that the 
system is expensive and labor-intensive. At present, a tabletop 
VR system offering the same functionality is being developed 
to overcome some of the disadvantages mentioned above. 
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